Sequential optimizing investing strategy with 

neural networks 



Ryo Adachi*"^ 
Akimichi Takemura* 

February 2010 



Abstract 

In this paper we propose an investing strategy based on neural 
network models combined with ideas from game-theoretic probability 
of Shafer and Vovk. Our proposed strategy uses parameter values of 
a neural network with the best performance until the previous round 
(trading day) for deciding the investment in the current round. We 
compare performance of our proposed strategy with various strategies 
including a strategy based on supervised neural network models and 
show that our procedure is competitive with other strategies. 

1 Introduction 

A number of researches have been conducted on prediction of financial time 
series with neural networks since Rumelhart [lOj developed back propagation 
algorithm in 1986, which is the most commonly used algorithm for supervised 
neural network. With this algorithm the network learns its internal structure 
by updating the parameter values when we give it training data containing 
inputs and outputs. We can then use the network with updated parameters 
to predict future events containing inputs the network has never encountered. 
The algorithm is applied in many fields such as robotics and image process- 
ing and it shows a good performance in prediction of financial time series. 
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Relevant papers on the use of neural network to financial time series include 
0, i, i and m- 

In these papers authors are concerned with the prediction of time series 
and they to not pay much attention to actual investing strategies, although 
the prediction is obviously important in designing practical investing strate- 
gies. A forecast of tomorrow's price does not immediately tell us how much 
to invest today. In contrast to these works, in this paper we directly consider 
investing strategies for financial time series based on neural network models 
and ideas from game-theoretic probability of Shafer and Vovk (2001) [TT] . 
In the game-theoretic probability established by Shafer and Vovk, various 
theorems of probability theory, such as the strong law of large numbers and 
the central limit theorem, are proved by consideration of capital processes 
of betting strategies in various games such as the coin-tossing game and the 
bounded forecasting game. In game-theoretic probability a player "Investor" 
is regarded as playing against another player "Market". In this framework 
investing strategies of Investor play a prominent role. Prediction is then de- 
rived based on strong investing strategies (cf. defensive forecasting in [13]). 

Recently in [H] we proposed sequential optimization of parameter values of 
a simple investing strategy in multi-dimensional bounded forecasting games 
and showed that the resulting strategy is easy to implement and shows a 
good performance in comparison to well-known strategies such as the uni- 
versal portfolio [3] developed by Thomas Cover and his collaborators. In this 
paper we propose sequential optimization of parameter values of investing 
strategies based on neural networks. Neural network models give a very flex- 
ible framework for designing investing strategies. With simulation and with 
some data from Tokyo Stock Exchange we show that the proposed strategy 
shows a good performance. 

The organization of this paper is as follows. In Section [2] we propose 
sequential optimizing strategy with neural networks. In Section |3] we present 
some alternative strategies for the purpose of comparison. In Section 13.11 
we consider an investing strategy using supervised neural network with back 
propagation algorithm. The strategy is closely related to and reflects exist- 
ing researches on stock price prediction with neural networks. In Section 13.21 
we consider Markovian proportional betting strategies, which are much sim- 
pler than the strategies based on neural networks. In Section |4] we evaluate 
performances of these strategies by Monte Carlo simulation. In Section [5] 
we apply these strategies to stock price data from Tokyo Stock Exchange. 
Finally we give some concluding remarks in Section O 
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2 Sequential optimizing strategy with neural 
networks 



Here we introduce the bounded forecasting game of Shafer and Vovk JJT\ 
in Section 12.11 and network models we use in Section 12.21 In Section 12.31 we 
specify the investing ratio by an unsupervised neural network and we propose 
sequential optimization of parameter values of the network. 

2.1 Bounded forecasting game 

We present the bounded forecasting game formulated by Shafer and Vovk 
in 2001 [11]. In the bounded forecasting game, Investor's capital at the end 
of round n is written as /C„ {n = 1,2,...) and initial capital /Co is set to 
be 1. In each round Investor first announces the amount of money M„ he 
bets {\Mn\ < /C„_i) and then Market announces her move Xn G [—1,1]. Xn 
represents the change of the price of a unit financial asset in round n. The 
bounded forecasting game can be considered as an extension of the classical 
coin-tossing game since the bounded forecasting game results in the classical 
coin-tossing game if x„ G {—1,1}. With /C„,M„ and Xn, Investor's capital 
after round n is written as /C„ = /C„_i + M„a;„. 

The protocol of the bounded forecasting game is written as follows. 

Protocol: 

/Co =1. 

FOR n = 1,2,... : 

Investor announces M„ G R. 
Market announces x„ G [—1, 1]. 

ICn = /C„_i + MnXn 

END FOR 

We can rewrite Investor's capital as /C„ = /C„_i x (1 + q;„x„), where 
an = M„//C„_i is the ratio of Investor's investment M„ to his capital /C„_i 
after round n — 1. We call a„ the investing ratio at round n. We restrict a„ as 
— 1 < a„ < 1 in order to prevent Investor becoming bankrupt. Furthermore 
we can write /C„ as 



Kn = /C„,_i(l + anXn) 



n^=i(l + afcXfc). 



Taking the logarithm of /C„ we have 



n 




(1) 



k=l 
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The behavior of Investor's capital in ([T]) depends on the choice of a^- 
Specifying a functional form of is regarded as an investing strategy. For 
example, setting Ofc = e to be a constant e for all k is called the e-strategy 
which is presented in [iTj. In this paper we consider various ways to determine 
ak in terms of past values Xfc-i, . . . , of x and and seek better au in trying 
to maximize the future capital /C„, n > k. 

Let Uk-i = (xfc-i, . . . , Xk-L) denote past L values of x and let depend 
on Uk-i and a parameter u: ak = f{uk-.i,uj). Then 

fc-i 

Wfc.i = argmax ^log(l + f{ut-i,uj)xt) 
t=i 

is the best parameter value until the previous round. In our sequential op- 
timizing investing strategy, we use uj^-i determine the investment M„ at 
round n: 

M„ = JCn-i X /(n„_i,a;*_i). 

For the function / we employ neural network models for their flexibility, 
which we describe in the next section. 

2.2 Design of the network 

We construct a three-layered neural network shown in Figure [TJ The input 
layer has L neurons and they just distribute the input Uj (j = 1, . . . , L) to 
every neuron in the hidden layer. Also the hidden layer has M neurons and 
we write the input to each neurons as If which is a weighted sum of m^'s. 
As seen from Figure [H If is obtained as 

L 

t2 \^ 1,2 

i=i 

where oolj'^ is called the weight representing the synaptic connectivity between 
the jth neuron in the input layer and the ith neuron in the hidden layer. Then 
the output of the ith neuron in the hidden layer is described as 

l/2 = tanh(/2). 

As for activation function we employ hyperbolic tangent function. In a sim- 
ilar way, the input to the neuron in the output layer, which we write is 
obtained as 

M 

7-3 2,3 2 

^ = l^^i Vi^ 

i=l 
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Figure 1: Three- layered network 



where ooj is the weight between the ith neuron in the hidden layer and the 
neuron in the output layer. Finally, we have 

= tanh(J^), 

which is the output of the network. In the following argument we use as 
an investment strategy. Thus we can write 

where 

/ 1,2 2,3\ // 1,2\ / 2,3\ \ 

= (o; • ,a; • ) = ((w^j )»=i,...,M,i=i,...,L, (w^ ' )i=i,...,Mj- 
Investor's capital is written as 

/C„ = /C„_i(l + /(n„„i,a;)x„). 

We need to specify the number of inputs L and the number of neurons M 
in the hidden layer. It is difficult to specify them in advance. We compare 
various choices of L and M in Section H] and Section [51 Also in we 
can include any input which is available before the start of round n, such 
as moving averages of past prices, seasonal indicators or past values of other 
economic time series data. We give further discussion on the choice of Un-i 
in Section O 
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2.3 Sequential optimizing strategy with neural net- 
works 

In this section we propose a strategy which we call Sequential Optimizing 
Strategy with Neural Networks (SOSNN). 

We first calculate uj* = uj^-i that maximizes 

n-l 

= ^log(l + /K_i,cx;)x,). (2) 

fc=i 

This is the best parameter values until the previous round. If Investor uses 
an = f{un-i, '^^--i) as the investing ratio, Investor's capital after round n is 
written as 



For maximization of ([2]), we employ the gradient descent method. With 
this method, the weight updating algorithm of oo'f'^ with the parameter /3 
(called the learning constant) is written as 



2,3 2,3 I A 2,3 2,3 i n 



where 



d(f) d(j) df ^d(j) df dH^ 



E 



a^" d!a4'' ^ a/ 3 'Paw" 

n-l 



^ l + /(nfe_i,Lc;)xfe' 



k 
n-l 

Ekx h 2 
Ol Vi, 

k=l 

and the left superscript k to P , yf indexes the round. Thus we obtain 

, n-l 

= B 



A, 2,3 Q qS^ kj: k2 



k=l 



Similarly, the weight updating algorithm of uj]f is expressed as 



1,2 1,2 , A 1>2 1,2 , o "-r 
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where 

- 1^ d kj2 Q 1,2 - 2^-gfgkpQky2g kj2 g 1,2 

^"^IJ k=l * U fc = l ■' * 2J 

n-1 

k=X 
n-1 

= ^ ^(52 {,Uk-i)j. 
k=l 

Thus we obtain 

Here we summarize the algorithm of SOSNN at round n. 

1. Given the input vector Uk^i = {xk-i, ■ ■ ■ , Xk-b) {k = 1, . . . ,n — 1) and 

L 

the value of we first evaluate = ''^^ojlj'^{uk-i)j and then 

= tanhC^Jj^). Also we set the learning constant /3. 

M 

2. We calculate ''P = ^ cof'^ %1 and then = tanhC"/^) with '"/^^ and 

i=l 

of the previous step. Then we update weight uj with the weight updat- 

n— 1 n— 1 

ing formula cuf ' = ' + ^ ^ and = + %{uk^i)y 

k=l k=l 

3. Go back to step 1 replacing the weight oJn-i with updated values. 
After sufficient times of iteration, in ([2]) converges to a local maximum 

1 2 2 3 1 2 1 2* 2 3 2 3* 

with respect to uj^j and ' and we set = and ' =00^' , which 
are elements of oj^^i- Then we evaluate Investor's capital after round n as 

3 Alternative investment strategies 

Here we present some strategies that are designed to be compared with 
SOSNN. In Section 13.11 we present a strategy with back-propagating neural 
network. The advantage of back-propagating neural network is its predictive 
ability due to "learning" as previous researches show. In Section we show 
some sequential optimizing strategies that use rather simple function for / 
than SOSNN does. 
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3.1 Optimizing strategy with back propagation 

In this section we consider a supervised neural network and its optimization 
by back propagation. We call the strategy NNBP. It decides the betting 
ratio by predicting actual up-and-downs of stock prices and can be regarded 
as incorporating existing researches on stock price prediction. Thus it is 
suitable as an alternative to SOSNN. 

For supervised network, we train the network with the data from a train- 
ing period, obtain the best value of the parameters for the training period 
and then use it for the investing period. These two periods are distinct. For 
the training period wc need to specify the desired output (target) of the 
network for each day k. We propose to specify the target by the direction of 
Market's current price movement x^- Thus we set 



n. 



Note that this Tk is the best investing ratio if Investor could use the current 
movement x^. of Market for his investment. Therefore it is natural to use 
Tk as the target value for investing strategies. We keep on updating u)k by 
cycling through the input-output pairs of the days of the training period and 
finally obtain uj* after sufficient times of iteration. 

Throughout the investing period we use u}* and Investor's capital after 
round n in the investing period is expressed as 

/C„ = /C„_i(l + UJ*)Xn). 

1 2 2 3 

Back propagation is an algorithm which updates weights and 
so that the error function 

Ek^lin-vr 

decreases, where is the desired output of the network and is the actual 

k" 2 3 

output of the network. The weight ' of day k is renewed to the weight 




of day A; + 1 



as 



where 
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Also weight 'lOj^j is renewed as 



1,2 _ fc 1,2 , Afci,2_A;i,2 o9Ek _u 1,2 dEk OH^ dhjf d^lf 



k 1,2 n k2 f- 



where 



At the end of each step we calculate the training error defined as 



m ^ m 



training error = ^ ^^(r, - = E (3) 

k=l k=l 

where m is the length of the training period. We end the iteration when 
the the training error becomes smaller than the threshold fi, which is set 
sufficiently small. 

Here let us summarize the algorithm of NNBP in the training period. 

1. We set k = l. 

2. Given the input vector Uk-i = {xk~i, ■ ■ ■ ,Xk-L) and the value of uJk, 

L 

we first evaluate ''If = ''^''ul-'^{uk-i)j and then hjf = tanh(*!/f). Also 
we set the learning constant /3. 



3. We calculate ^/^ = ^ ^ \2 ^^^^ ^j^^^ a^s ^ tanh(^/3) with ''If and 



M 
i=l 

of the previous step. Then we update weight uJk with the weight updat- 
ing formula ''+\u-'^ = 'lu-'^ - (3 ^e^ V ^nd ''+\ulf = \j\f - l3 ''ef{uk-i)j. 

4. Go back to step 2 setting + 1 and u^^+i ^ <jJk while 1 < fc < m. 
When fc = m we set fc = 1 and uji ^ cj^+i and continue the algorithm 
until the training error becomes less than /i. 



3.2 Markovian proportional betting strategies 

In this section we present some sequential optimizing strategies that are 
rather simple compared to strategies with neural network in Section [2] and 
Section 13. 11 The strategies of this section are generalizations of Markovian 
strategy in [12] for coin-tossing games to bounded forecasting games. We 
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present these simple strategies for comparison with SOSNN and observe how 
complexity in function / increases or decreases Investor's capital processes 
in numerical examples in later sections. 

Consider maximizing the logarithm of Investor's capital in ([1]): 

n 

log/C„ = ^log(l + akXk). 

k=l 

We first consider the following simple strategy of [9] in which we use a„ = 
a^_i, where 

ctn-i = argmax n^~|(l + ax^)- 

In this paper we denote this strategy by MKVO. 

As a generalization of MKVO consider using different investing ratios 
depending on whether the price went up or down on the previous day. Let 
ak = when Xk-i was positive and = when it was negative. We 
denote this strategy by MKVl. In the betting on the nth day we use = 
a^_i* and a~ = where 

a~_^*) = argmax n^=i(l + /(wfc-i, a^, a~)xk), 

Uk-i = (xk-i) and 

f{uk-i, a+, a~) = a^l{xk-i>o} + <^~hxk-i<o}- 

Here I{.} denotes the indicator function of the event in {■}. The capital 
process of MKVl is written in the form of ([T]) as 

n 

hgJCn = J^log(l + /('Ufc_i,a^_^*,a^_^*)xfc). 

k=l 

We can further generalize this strategy considering price movements of 
past two days. Let Uk-i = (xfc_i,Xfc_2) and let 

f{uk-i, a^^, , a~^, a ) = tt^^I{xfc_2>o, a;fe_i>o} + Oi^~hxk_2>o, Xk-i<o} 

+ a""^I{xfc_2<o, Xk-i>o} + tt I{xfc_2<,Xfe_i<o}- 

We denote this strategy by MKV2. 

We will compare performances of the above Markovian proportional bet- 
ting strategies with strategies based on neural networks in the following sec- 
tions. 
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4 Simulation with linear models 



In this section we give some simulation results for strategies shown in Sec- 
tion [2] and Section [31 We use two linear time series models to confirm the 
behavior of presented strategies. Linear time series data are generated from 
the Box- Jenkins family [2], autoregressive model of order 1 (AR(1)) and au- 
toregressive moving average model of order 2 and 1 (ARMA(2,1)) having the 
same parameter values as in [15]. AR(1) data are generated as 

Xn = 0.6x„_i + e„ (4) 

and ARMA(2,1) data are generated as 

Xn = 0.6x„_i + 0.3x„__2 + e„ - 0.5e„_i, (5) 

where we set e„ ~ N{0, 1). After the series is generated, we divide each value 
by the maximum absolute value to normalize the data to the admissible range 

[-1,1]- 

Here we discuss some details on calculation of each strategy. First we 
set the initial values of elements of oj as random numbers in [—0.1,0.1]. In 
SOSNN, we use the first 20 values of Xn as initial values and the iteration 
process in gradient descent method is proceeded until lAwj^^^^l < 10""^ and 
lAu^'^l < 10~^ with the upper bound of lO'* steps. As for the learning 
constant /3, we use learning-rate annealing schedules which appear in Section 
3.13 of [7]. With annealing schedule called the search-then-converge schedule 
|1] we put f3 at the nth step of iteration as 

/3{n) 



1 + {n/r) ■ 



where (3o and r are constants and we set /3o = 1-0 and r = 5.0. In NNBP, 
we train the network with five different training sets of 300 observations 
generated by (jl]) and ([5]). We continue cycling through the training set until 
the training error becomes less than and we set /x = 10~^ with the upper 
bound of 6 X 10^ steps. Also we check the fit of the network to the data 
by means of the training error for some different values of P, L and M. In 
Markovian strategies, we again use the first 20 values of Xn as initial values. 
We also adjust the data so that the betting is conducted on the same data 
regardless of L in SOSNN and NNBP or different number of inputs among 
Markovian strategies. 

In Table □ we summarize the results of SOSNN, NNBP, MKVO, MKVl 
and MKV2 under AR(1) and ARMA(2,1). The values presented are averages 
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of results for five different simulation runs of (jl]) and (jS]). As for SOSNN, 
we simulate fifty cases (combinations of L = 1, . . . , 5 and M = 1, . . . , 10), 
but only report the cases of L = 1,2,3 and some choices of M because the 
purpose of the simulation is to test whether L = 1 works better than other 
choices of L under AR(1) and L = 2 works better under ARMA(2,1). For 
NNBP we only report the result for one case since fitting the parameters to 
the data is quite a difficult task due to the characteristic of desired output 
(target). Also once we obtain the value of /3, L and M with training error 
less than the threshold /i = 10~^, we find that the network has successfully 
learned the input-output relationship and we do not test other choices of the 
above parameters. (See Appendix for more detail.) We set (3 = 0.07, L = 12 
and M = 30 in simulation with AR(1) model and /3 = 0.08, L = 15 and 
M = 40 in simulation with ARMA(2,1) model. 

Investor's capital process for each choice of L and M in SOSNN, NNBP 
and each Markovian strategy is shown in three rows, corresponding to rounds 
100, 200, 300 of the betting (without the initial 20 rounds in SOSNN and 
Markovian strategies). The fourth row of each result for NNBP shows the 
training error after learning in the training period. The best value among the 
choices of L and M in SOSNN or among each Markovian strategy is written 
in bold and marked with an asterisk and the second best value is also written 
in bold and marked with two asterisks. Also calculation results written with 
" — " are cases in that simulation did not give proper values for some reasons. 

Notice that SOSNN whose betting ratio / is specified by a complex func- 
tion gives better performance than rather simple Markovian strategies both 
under AR(1) and ARMA(2,1). Also the result that NNBP gives capital pro- 
cesses which are competitive with other strategies shows that the network 
has successfully learned the input-output relationship in the training period. 

5 Comparison of performances with some stock 
price data 

In this section we present numerical examples calculated with the stock price 
data of three Japanese companies SONY, Nomura Holdings and NTT listed 
on the first section of the Tokyo Stock Exchange for comparing betting strate- 
gies presented in Section [2] and Section [31 The investing period (without days 
used for initial values) is 300 days from March 1st in 2007 to June 19th in 
2008 for all strategies and the training period in NNBP is 300 days from 
December 1st in 2005 to February 20th in 2007. We use a shorter training 
period than those in previous researches, because longer periods resulted in 
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Table 1: Log capital processes of SOSNN, NNBP, MKVO, MKVl, MKV2 
under AR(1) and ARMA(2,1) 



AR(1) model 

SOSNN 



AA/ 


1 


2 


3 


4 


5 


6 


7 


8 




9.890 


9.168 


10.021* 


10.007 


9.982 


9.559 


10.009** 


9.821 


1 


18.285 


17.436 


17.241 


17.709 


18.480* 


17.542 


18.260** 


16.991 




30.151 


23.574 


29.465 


29.949 


32.483* 


28.941 








7.476 


7.132 


7.864 


8.004 


7.267 


8.738 


6.009 


7.771 


2 


14.983 


12.710 


15.518 


17.350 


13.914 


13.614 




12.016 




26.211 


25.785 


26.090 


32.144** 


21.981 


23.137 




19.492 




8.128 


9.084 


5.427 




2.922 


7.291 


5.209 


5.989 


3 


13.934 


12.242 


11.166 




8.607 


11.539 


8.311 


10.994 




23.232 


19.889 


20.013 




16.330 


18.807 


16.055 


20.388 



NNBP MKVO MKVl MKV2 

10.118 -1.175 7.831* 6.517 

11.921 -0.800 16.974* 15.452 

24.323 -1.647 32.392* 30.875 

(5.28 X 10"^) 



ARMA(2,1) model 

SOSNN 



L\M 12 3 4 5678 





4.985 


5.292 


4.350 


4.532 


4.052 


3.563 


3.408 


1.522 


1 


10.234 


11.108 


9.905 


8.793 


10.012 


8.411 


8.029 


4.746 




11.666 


11.460 


10.024 


9.924 


11.781 


8.016 




5.882 




8.518 


10.287 


11.052** 


11.567* 


9.147 


8.483 


6.915 


5.579 


2 


18.474 


20.177 


21.458* 


20.768** 


13.030 


12.042 




13.573 




16.818 


25.167* 


24.979 


25.114** 


17.538 


15.074 




16.846 




8.511 


10.490 


7.344 


7.883 


7.409 


7.445 


7.011 


5.772 


3 


15.401 


18.241 


18.120 


15.697 




12.395 




11.961 




18.047 


24.904 


23.362 


21.280 




15.930 




14.185 



NNBP MKVO MKVl MKV2 

7.813 -0.729 3.160 7.566* 

15.420 -0.132 10.483 17.619* 

25.819 -2.422 13.375 22.911* 
(2.04 X 10"^) 



poor fitting. 

The data for 300 days from December 1st in 2005 to February 20th in 2007 
is used for input normalization of x„ to [—1,1], which is conducted according 
to the method shown in pLj and the procedure is as follows. For the data 
of daily closing prices in the above period, we first obtain the maximum 
value of absolute daily movements and then divide daily movements in the 
investing period by that maximum value. In case x„ < —1.0 or x„ > 1.0 
we put Xn = —1.0 or x„ = 1.0. Thus we obtain x„ in [—1, 1] and we use 
them for inputs of the neural network. We tried periods of various lengths 
for normalization and decided to choose a relatively short period to avoid 
Investor's capital processes staying almost constant. Also in NNBP we used 
13 = 0.07, L = 12 and M = 90 for SONY, /3 = 0.07, L = 15 and M = 100 for 
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Nomura and /3 = 0.03, L = 15 and M = 120 for NTT with upper bound of 
10^ iteration steps. Other details of calculation are the same as in Section m 
We report the results in Table [2l 

In Figure [2] we show the movements of closing prices of each company 
during the investing period. In Figures |3]|5] we show the log capital processes 
of the results shown in Table [2] to compare the performance of each strategy. 
Figure [3] is for SONY, Figure S] is for Nomura Holdings and Figure is for 
NTT. For SOSNN we plotted the result of L and M that gave the best 
performance at n = 300 (the bottom row of the three rows) in Table [2l 





100 150 200 250 300 

Rounds 



Figure 2: Closing prices 



Figure 3: SONY 




SOSNN - 
NNBP - 
MKVO 



Figure 4: Nomura 



Figure 5: NTT 



As we see from above figures, NNBP which shows competitive perfor- 
mance for two linear models in Section H] gives the worst result. Thus it is 
obvious that the network has failed to capture trend in the betting period 
even if it fits in the training period. Also the results are favorable to SOSNN 
if we adopt appropriate numbers for L and M. 
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Table 2: Log capital process of SOSNN, NNBP, MKVO, MKVl and MKV2 
for TSE stocks 



SONY 

SOSNN 



AM 


1 


2 




4 


5 


7 


8 


9 




-0.339 


-0.292 


0, 


.144** 


-0.832 


-0.964 


-0.896 


0.082 


1 


0.572 


0.520 


1, 


.438** 


0.401 


0.383 


-0.433 


2.012* 




-0.153 


-0.220 





.461** 


-0.633 


-0.762 


-1.283 


0.582* 




-0.329 


0.163 




-1.273 


-0.675 


-0.349 


-2.056 


-2.541 


2 


0.000 


-0.260 




-1.825 


-1.420 


-0.072 


-1.100 


-1.256 




-0.565 


-0.412 




-2.274 


-2.006 


-0.980 


-2.490 


-1.981 




-0.230 


-1.448 




-1.402 


-1.232 


0.397* 


-0.627 


-1.404 


3 


-0.309 


-1.823 




-0.438 


-0.695 


0.970 


-0.599 


0.281 




-0.307 


-2.237 




-1.333 


-1.843 


-0.212 


-1.827 


-2.749 



NNBP MKVO MKVl MKV2 

-1.039 -0.678 —0.459* -1.285 

-2.557 -0.979 1.414* -0.482 

-3.837 -1.260 —0.212* -2.297 
(3.67 X 10-^) 





0.200 


-0.212 


-1.309 


-0.479 


0.839* 


0.679** 


-0.726 


1 


1.193* 


0.764 


-2.417 


-0.370 


-2.660 


0.005 


-1.212 




-3.326 


-2.888 


-2.333 


0.581** 


-6.938 


-4.979 


-0.504 




-0.819 


0.338 


-4.148 


0.229 


-4.787 


-1.662 


-0.754 


2 


-0.969 


1.030** 


-4.920 


-0.007 


-11.478 


-3.385 


-10.046 




-0.202 


1.127* 


-4.941 


-7.003 


-18.795 


-10.897 


-22.861 




-1.066 


-2.076 


-1.458 


-0.389 


-2.926 


-1.783 


-2.451 


3 


-1.111 


1.002 


-6.307 


0.198 


-2.897 


-6.264 


-9.696 




-3.672 


-1.699 


-10.670 


-3.886 


-0.621 


-8.420 


-14.021 




NNBP 


MKVO 


MKVl 


MKV2 




-0.743 


—0.883* 


-1.911 


-3.789 




-8.087 


-0.753* 


-1.364 


-4.970 




-16.051 


— 1. 


.390* 


-1.962 


-6, 


.410 



(2.03 X 10-^) 





-0.674 


-0.366 


1 


-0.826 


-0.411 




-1.115 






-1.269 


-6.049 


2 


-1.175 


-8.333 




— 0.498** 


-10.660 




-0.377 


-3.131 


3 


—0.431** 


-6.861 




0.092* 


-6.463 



-5.476 
-9.581 



-2.192 
-1.366 



0.880** 

-4.248 

-2.769 
-5.377 
-7.137 

-4.449 
-9.349 
-14.684 



-6.673 
-4.472 



-7.899 
-11.071 



-1.670 
-16.990 



0.888* 

-7.931 



-6.606 
-9.206 
-13.900 

-10.896 
-10.811 



-4.767 
-4.386 



L134 
1.250 



-8.633 
-12.316 
-16.466 



NNBP 



MKVO 



-4.166 
-3.161 

-5.669 

(3.7:i \ If)" 



-0.902* 
-1.272* 

-1.566* 



-2.048 
-2.642 

-3.391 



-4.788 
-6.807 

-8.687 
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6 Concluding remarks 



We proposed investing strategies based on neural networks which directly 
consider Investor's capital process and are easy to implement in practical 
applications. We also presented numerical examples for simulated and actual 
stock price data to show advantages of our method. 

In this paper we only adopted normalized values of past Market's move- 
ments for the input Un-i while we can use any data available before the 
start of round n as a part of the input as we mentioned in Section 12.21 Let 
us summarize other possibilities considered in existing researches on finan- 
cial prediction with neural networks. The simplest choice is to use raw data 
without any normalization as in [6J, in which they analyze time series of 
Athens Stock index to predict future daily index. In [5] they adopt price 
of FAZ-index (one of the German equivalents of the American Dow- Jones- 
Index), moving averages for 5, 10 and 90 days, bond market index, order 
index, US-Dollar and 10 successive FAZ-index prices as inputs to predict the 
weekly closing price of the FAZ-index. Also in [5] they use 12 technical in- 
dicators to predict the S&P 500 stock index one month in the future. From 
these researches we see that for longer prediction terms (such as monthly or 
yearly), longer moving averages or seasonal indexes become more effective. 
Thus those long term indicators may not have much effect in daily price pre- 
diction which we presented in this paper. On the other hand, adopting data 
which seems to have a strong correlation with closing prices of Tokyo Stock 
Exchange such as closing prices of New York Stock Exchange of the previous 
day may increase Investor's capital processes presented in this paper. Since 
there are numerical difficulties in optimizing neural networks, it is better to 
use small number of effective inputs for a good performance. 

Another important generalization of the method of this paper is to con- 
sider portfolio optimization. We can easily extend the method in this paper 
to the betting on multiple assets. Let the output layer of the network have 
P neurons as shown in Figure [7| and the output of each neuron is expressed 
as yl, h = 1, . . . ,P. Then we obtain a vector = {yf, . . . , yf,) of outputs. 
The number of neurons P refers to the number of different stocks Investor 
invests. 

Investor's capital after round n is written as 



p 




h=l 



where 
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Stock 1 Stock h Stock P 




Figure 6: Three-layered network for portfolio cases 



Thus also in portfolio cases we see that our method is easy to implement and 
we can evaluate Investor's capital process in practical applications. 

Appendix 

Here we discuss training error in the training period of NNBP. In this paper 
we set the threshold fi for ending the iteration to 10~^, while the value 
commonly adopted in many previous researches is smaller, for instance, n = 
10~^. We give some details on our choice of /i. 

Let us examine the case of Nomura Holdings in Section [51 In Figure [7] 
we show the training error after each step of iteration in the training period 
calculated with ([3]). While the plotted curve has a typical shape as those of 
previous researches, it is unlikely that the training error becomes less than 
10~^. Also in Figure E] we plot Ek = |(Tfc — for each k calculated with 
parameter values lj after learning. We observe that the network fails to fit 
for some points (actually 9 days out of 300 days) but perfectly fits for all 
other days. It can be interpreted that the network ignores some outliers and 
adjust to capture the trend of the whole data. 
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Figure 7: training error (epochs) Figure 8: training error (periods) 
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